Stacked on #2746. Generalizes ECHO's token selection, porting the selection vocabulary from @snimu's #2677 onto the component weight streams.

What changes

Per-role echo weights. The observations = "tool" | "all" binary becomes a role table — each env-provided message role trains at its own α, selected via the renderer's per-token attribution (message_indices / message_roles / is_content):

[orchestrator.algo.advantage]
type = "echo"

[orchestrator.algo.advantage.roles.tool]
alpha = 0.25

[orchestrator.algo.advantage.roles.user]
alpha = 0.05

The echo preset is unchanged in meaning: tool-response bodies at alpha = 0.1. Presets stay atomic; setting any role replaces the whole table.

User-supplied token filter. An optional hook narrows the role selection per rollout — e.g. dropping warning lines from tool output, or tokens the sampler found unlikely. Config matches the custom advantage/loss precedent (import_path + kwargs); the signature is #2677's:

[orchestrator.algo.advantage.filter]
import_path = "my_module.drop_warnings"
kwargs = { patterns = ["WARNING"] }

def drop_warnings(rollout, *, patterns: list[str]) -> list[list[bool]]:
    # one keep-mask per trajectory step, spanning prompt_ids + completion_ids
    ...

The callable sees the raw rollout (message text, sampling logprobs), so content filters and sampling-probability filters need no further framework surface. Shape violations fail loudly. The filter can only narrow the selection, never widen it.

How it works

completion_obs_mask (bool, orchestrator-internal) becomes completion_obs_weights (float): each selected token carries its role's α from interleave_rollout, and stamp_loss_routing folds the weights into the ce_weights stream directly — the scalar observation_weight parameter is gone. Trainer untouched: per-component global normalization already keeps echo tokens out of the rl denominator, and a zero weight excludes a token from the ce component's numerator and denominator (true masking, not dilution).

Breaking (pre-merge, no compat shims)

• advantage.observation_weight / advantage.observations are replaced by advantage.roles.<role>.alpha.
• Echo now always requires orchestrator.renderer (role selection needs attribution). The blanket "all" mode is gone — assemble the roles you want instead.

Not in this PR

• tool_names filtering (restrict echo to specific tool functions) — deferred; non-breaking optional field on the tool role later, message_tool_names already rides in the attribution.
• Live-θ probability filters ("mask tokens with low prob under the current policy") — structurally trainer-side (θ doesn't exist at stamping); separate small PR if needed.

🤖 Generated with Claude Code